Classroom note-taking system for hearing impaired students using automatic speech recognition adapted to lectures
نویسندگان
چکیده
We are developing a real-time lecture transcription system for hearing impaired students in university classrooms. The automatic speech recognition (ASR) system is adapted to individual lecture courses and lecturers, to enhance the recognition accuracy. The ASR results are selectively corrected by a human editor, through a dedicated interface, before presenting to the students. An efficient adaptation scheme of the ASR modules has been investigated in this work. The system was tested for a hearing-impaired student in a lecture course on civil engineering. Compared with the current manual note-taking scheme offered by two volunteers, the proposed system generated almost double amount of texts with one human editor.
منابع مشابه
Improving Speech Recognition to Assist Real - time Classroom Note Taking
Speech recognition systems have advanced to the point where they are a viable option for providing note taking assistance for deaf and hard of hearing students. College lectures, which frequently contain domain-specific or uncommon terminology, provide a challenge for these systems that typically rely on a dictionary of common words to guide recognition. This paper reports on a prototype text a...
متن کاملExtension of the LECTRA corpus: classroom LECture TRAnscriptions in European Portuguese
This paper presents the recent extension of the LECTRA corpus, a speech corpus of university lectures in European Portuguese that will be partially available. Eleven additional hours of various lectures were transcribed, following the previous multilayer annotations, and now comprising about 32 hours. This material can be used not only for the production of multimedia lecture contents for e-lea...
متن کاملStructuring the Unstructured Note: Automatic Organizing and Formatting for lecture notes
“Note taking is an important practice during lectures. With the rapid development of electronic devices such as smart phones, tablets and laptops, digital note-taking has become an option for many students. In the classroom setting, note takers might fail to record clearly organized notes due to limitations of time and devices. Therefore, users often need to manually organize long paragraphs of...
متن کاملRooms Take Note: Room Takes Notes!
Students in university lectures try to capture the classroom experience by taking notes. In many classes, this is a tedious process and distracts the student from concentrating on the lecture. In this paper, we present a classroom that takes media-enhanced notes on behalf of the students thereby allowing them to give more attention to understanding the material rather than trying to record it. ...
متن کاملLearning via direct and mediated instruction by deaf students.
Four experiments investigated classroom learning by deaf college students receiving lectures from instructors signing for themselves or using interpreters. Deaf students' prior content knowledge, scores on postlecture assessments of content learning, and gain scores were compared to those of hearing classmates. Consistent with prior research, deaf students, on average, came into and left the cl...
متن کامل